A recursive algorithm for nonlinear least-squares problems
نویسندگان
چکیده
The solution of nonlinear least-squares problems is investigated. The asymptotic behavior is studied and conditions for convergence are derived. To deal with such problems in a recursive and efficient way, it is proposed an algorithm that is based on a modified extended Kalman filter (MEKF). The error of the MEKF algorithm is proved to be exponentially bounded. Batch and iterated versions of the algorithm are given, too. As an application, the algorithm is used to optimize the parameters in certain nonlinear input–output mappings. Simulation results on interpolation of real data and prediction of chaotic time series are shown. A. Alessandri and M. Cuneo were partially supported by the EU and the Regione Liguria through the Regional Programmes of Innovative Action (PRAI) of the European Regional Development Fund (ERDF). M. Sanguineti was partially supported by a grant from the PRIN project ‘New Techniques for the Identification and Adaptive Control of Industrial Systems’ of the Italian Ministry of University and Research. A. Alessandri Department of Production Engineering, Thermoenergetics, and Mathematical Models (DIPTEM), University of Genoa, P.le Kennedy Pad. D, 16129 Genova, Italy e-mail: [email protected] M. Cuneo · S. Pagnan Institute of Intelligent Systems for Automation, ISSIA-CNR National Research Council of Italy, Via De Marini 6, 16149 Genova, Italy M. Cuneo e-mail: [email protected] S. Pagnan e-mail: [email protected] M. Sanguineti ( ) Department of Communications, Computer and System Sciences (DIST), University of Genoa, Via Opera Pia 13, 16145 Genova, Italy e-mail: [email protected] 196 A. Alessandri et al.
منابع مشابه
Superlinearly convergent exact penalty projected structured Hessian updating schemes for constrained nonlinear least squares: asymptotic analysis
We present a structured algorithm for solving constrained nonlinear least squares problems, and establish its local two-step Q-superlinear convergence. The approach is based on an adaptive structured scheme due to Mahdavi-Amiri and Bartels of the exact penalty method of Coleman and Conn for nonlinearly constrained optimization problems. The structured adaptation also makes use of the ideas of N...
متن کاملMultiple Concurrent Recursive Least Squares Identification
A new algorithm, multiple concurrent recursive least squares (MCRLS) is developed for parameter estimation in a system having a set of governing equations describing its behavior that cannot be manipulated into a form allowing (direct) linear regression of the unknown parameters. In this algorithm, the single nonlinear problem is segmented into two or more separate linear problems, thereby enab...
متن کاملKALMAN FILTERING IN REPRODUCING KERNEL HILBERT SPACES By PINGPING ZHU A DISSERTATION PRESENTED TO THE GRADUATE SCHOOL OF THE UNIVERSITY OF FLORIDA IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY
of Dissertation Presented to the Graduate School of the University of Florida in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy KALMAN FILTERING IN REPRODUCING KERNEL HILBERT SPACES By Pingping Zhu May 2013 Chair: José C. Prı́ncipe Major: Electrical and Computer Engineering There are numerous dynamical system applications that require estimation or prediction from...
متن کاملApproximate QR-Based Algorithms for Recursive Nonlinear Least Squares Estiamtion
This paper proposes new approximate QR-based algorithms for recursive nonlinear least squares (NLS) estimation. Two QR decomposition-based recursive algorithms are introduced based on the classical Gauss-Newton (GN) and Levenberg-Marquardt (LM) algorithms in nonlinear unconstrained optimization or least squares problems. Instead of using the matrix inversion formula, recursive QR decomposition ...
متن کاملNonlinear System Identification using a New Sliding-Window Kernel RLS Algorithm
In this paper we discuss in detail a recently proposed kernel-based version of the recursive least-squares (RLS) algorithm for fast adaptive nonlinear filtering. Unlike other previous approaches, the studied method combines a sliding-window approach (to fix the dimensions of the kernel matrix) with conventional ridge regression (to improve generalization). The resulting kernel RLS algorithm is ...
متن کاملA Filtered-X RLS Algorithm for Nonlinear Active Noise Control
In this paper, a filtered-x recursive least squares (FX-RLS) algorithm based on adaptive 3rd-order Volterra filtering is proposed for nonlinear active noise control (ANC) of systems with a nonlinear primary acoustic path. The simulation results show that the proposed approach yields faster convergence, compared with the conventional methods (e.g., FX-NLMS and FX-GSPAP), for the nonlinear ANC. K...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Comp. Opt. and Appl.
دوره 38 شماره
صفحات -
تاریخ انتشار 2007